 EGUCQ zi, 
32 Noy, 


‘0, 
Up 
» 


Worl 
a 
B) 
ABO\O 


World Journal on 
Educational Technology 


2009 


Vol 6, Issue 2, (2014) 132-138 
www.awer-center/wjet 


The effect of Scratch environment on student’s achievement in 
teaching algorithm 


Mehmet Tekerek*, Department of Computer Education and Instructional Technology, Kahramanmaras 
Siittclimam University, Kahramanmaras, Turkey - Computer Engineering Department Kyrgyz Turkish 
Manas University, Bishkek, Kyrgyzstan 


Tugba Altan, Department of Computer Education and Instructional Technology, Middle East Technical 
University, Ankara, Turkey. 


Suggested Citation: 
Tekerek, M., & Altan, T. (2014). The effect of Scratch environment on student’s achievement in teaching 
algorithm. World Journal on Educational Technology, 6(2), 132-138. 


Received May 12, 2014; revised June 19, 2014; accepted July 23, 2014 
Selection and peer review under responsibility of Prof. Dr. Steven M. Ross, John hopkins University. 
©2014 Academic World Education & Research Center. All rights reserved. 


Abstract 


In this study, the effect of Scratch environment in teaching algorithm in elementary school 6th grade 
Information and Communication Technologies course was examined. The research method was experimental 
method. Control group, pretest-posttest design of experimental research method and a convenience sample 
consisting of 60 6th grade students were used. The research instrument was achievement test to determine the 
effect of Scratch on learning algorithm. During the implementation process experiment group studied using 
Scratch and control group studied with traditional methods. The data was analyzed using independent-samples 
t-test, paired-samples t-test and ANCOVA statistics. According to findings there is no statically significant 
difference between posttest achievement scores of experiment and control groups. Similarly, In terms of gender 
there isn’t a statically significant difference between posttest scores of experiment and control groups. 
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1. Introduction 


The word “algorithm” is originated Abdullah Muhammad ibn Musa al-Khwarizmi’s name and he is 
known for his work in the field of algebra in the ninth century (Dasgupta, Papadimitriou & Vazirani, 
2006; Fellows, Bell & Witten, 2005). In the fifteenth century, Fibonacci created his sequence of 
numbers that is called with his name based on al-Khwarizmi’s studies and this method was applied in 
the field of computer programming with some other fields (Dasgupta et al., 2006). Algorithm is 
defined commonly as “...the way for solving a problem...” (Aydin, Hoscan & Ozkul, 2004, p. 294) or “... 
a set of instructions...” that are required to follow “... for completing a task...” (Fellows et al., 2005). In 
the process of creating an algorithm that is the most important step of computer programming, the 
flow including instructions to solve the problem and decisions that will be taken is determined (Aydin 
et al., 2004). 


The traditional methods with using paper-pencil are used to teach algorithm and instructors avoid 
using object-oriented programming in this process. But this method doesn’t allow testing whether the 
algorithm is correct, studying individually is too hard and causes time wasting in classroom (Vobornik, 
2011). For these reasons, it is “...one of the problems of the computer science... course is developing 
algorithmic and logical thinking...” (Ziatdinov & Musa, 2012) and students consider that learning 
algorithm is difficult and boring (Futschek & Moschitz, 2010). In order to find solutions to these 
problems, methods such as multimedia and computer-supported instructional technologies 
(Crescenzi, Malizia, Verri, Diaz & Aedo, 2012; Giiltekin, 2006; Vobornik, 2011), different mathematical 
methods (Ziatdinov & Musa, 2012) and discovery learning, role-playing (Futschek & Moschitz, 2010) 
are benefited in teaching algorithm. Also, in order to facilitate learning programming and make 
programming can be learned by anyone, various programming languages and learning environments 
have been developed (Conway, 1997; De Bonte, 1998; Resnick, et al., 2009; Utting, Cooper, K6lling, 
Maloney & Resnick, 2010). Scratch is one of these learning environments. Scratch that is one of the 
first developed programming languages for K-12 students was designed by focusing student 
engagement in programming environment and core computational concepts such as sequencing, 
iteration, and conditionals (Sivilotti & Laugel, 2008). Students create program procedures by snapping 
together graphical blocks like Lego bricks or jigsaw puzzle pieces. In this learning environment, it was 
tried to prevent students from syntax errors by presenting different data types as blocks of different 
shapes and fitting together in only correct syntaxes. The other features of Scratch learning 
environment are using and editing the desired images, adding sound or music and creating animations 
(Resnick et al., 2003). 


Students can share their projects that they develop in Scratch environment with other user in a web 
environment and thus Scratch offers a social environment as the same like video-sharing website 
YouTube. Student learn both important mathematical and computational concepts and creative 
thinking , systematically reasoning and studying collaboratively via making programs and sharing their 
projects in learning environment (Resnick et al., 2009). It is advocated that Scratch ensures that 
situation with the design that combines 21st century skills such as information and communication 
skills, creative and critical thinking, problem solving, communicating clearly, analyzing systematically, 
self-direction skills, collaborating effectively, designing iteratively and learning continuously (Learning 
with Scratch, 2012). 


Computer programming is taught at university and high school levels and although little level in K- 
12 level in Turkey. In K-12, 1st-8th graders’ Information and Communication Technologies (ICT) 
curriculum there are some acquisitions related with algorithm and computer programming subjects 
(Talim ve Terbiye Kurulu Baskanligi, 2012). This situation shows an attempt for teaching algorithm and 
computer programming subjects from young ages of children in our country. Similarly, Scratch was 
developed with considering students can learn programming earlier as they learn writing (Utting et al., 
2010). Also, some researchers emphasize that development of algorithmic thinking can start at K-12 
level (Futschek & Moschitz, 2011; Ziatdinov & Musa, 2012). 
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It was exposed by some researchers that there was an increase on student’s performance in the 
implementations of different methods for teaching programming and algorithms in the literature 
(Crescenzi et al., 2012; Futschek & Moschitz, 2010; Futschek & Moschitz, 2011; Gultekin, 2006; 
Monroy-Hernandez & Resnick, 2008; Peppler & Kafai, 2005, Resnick et al., 2009; Vobornik, 2011). 
Hence in this study, it was aimed to examine the impact of Scratch environment that was developed 
to provide an easy and funny way for learning computer programming by students, on student’s 
achievement in sixth grade ICT course algorithms subject. 


1.1. Research Question 


What is the impact of Scracth on student’s achievement in teaching sixth grade ICT course 
algorithms subject? 


1.1.1. Sub-Questions 
1. What is the impact of “Scracth” on student’s achievement? 


2. Is there a difference between students’ achievements in terms of gender? 


2. Methodology 
2.1. Research Design 


In the study control group pre-test post-test experimental design that is one of the quantitative 
research methods was used. At the beginning of the study, two groups were formed as experimental 
and control groups. During implementation process for game based instruction Scratch was used while 
teaching in experimental group. On the other hand lecturing was used in control group. 


2.2. Participants 


Sample of the study consist of 60 6th grade students in an elementary school in Kahramanmaras 
city center. One of the selected classes was assigned as experimental group and the other one was 
assigned as control group. There are 30 students in both groups. The numbers of girl and boy students 
in both groups are equal (15 girls and 15 boys). 


2.3. Instruments 


In the study an achievement test was developed for measuring algorithms units’ objectives as a 
data collection tool. This test includes 10 items that are easy to difficult. 


2.4. Implementation Process and Data collection 


Implementations were conducted between 27 April and 18 May 2012 in an elementary school in 
Kahramanmaras. Before implementation Scratch program orientation was given to experimental 
group. Then pre-test was conducted to control and experimental groups and class implementations 
were done. In control group ‘Algorithms’ subject was taught by lecturing and in experimental group 
for game based learning Scratch was used. After three weeks implementation post-test was 
conducted to both groups. 
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2.5. Data Analysis 


In the study for data analysis independent sample t-test was used to determine whether there is a 
Statistically significant difference between pre-test scores. Paired sample t-test was used to 
understand whether teaching methods have effect on students’ achievements. Additionally to 
determine whether there is a statistically significant difference between post-test scores and whether 
there is a statistically significant difference between students’ achievements in terms of gender, two- 
way ANCOVA was used for analyzing these data. In all statistical analyses significance level was taken 
as 0.05. 


3. Results 
3.1. The Effects of Scratch Program on Students’ Achievements 


To determine whether there is a significant difference between students’ pre-test mean scores in 
experimental and control groups, pre-test results (Table 1) were examined. 


Table 1. Independent Sample t-test results of Control and Experimental Groups’ Pre-test Mean Scores 


Groups N x SS Sd t p 
Control 30 4,1 1,446 
Experimental 30 4,56 1,568 58 -1,198 0,236 


As it was seen in Table 1, there is no significant mean difference between control (4,1) group and 
experimental (4,56) group (ts. = -1,198; p>0,05). It means students in control and experimental groups 
were not different in terms of having information about information technologies course algorithms 
subject. 


To determine whether learning occurs or not at the end of implementations in experimental and 
control groups, pre-test and post-test results (Table 2, Table 3) were compared. 


Table 2. Paired Sample t-test results of Control Group’s Pre-test and Post-test Scores 


Tests N x Ss Sd t 5 
Pre-test 30 4,10 1,44 
Post-test 30 7,46 1,27 29 -9,261 0,000 


In Table 2, control groups’ post-test scores (7,46) are higher than pre-test scores (4,10) and there is 
a Statistically significant mean difference between these tests (t,9= -9,261; p<0,05). This finding 
indicates that in control group with regular instruction there is a positive change on students’ leanings. 


Table 3. Paired Sample t-test results of Experimental Group’s Pre-test and Post-test Scores 


Tests N ra SS Sd : B 
Pre-test 30 4,56 1,56 
Post-test 30 6,63 2,40 29 -3,848 0,001 


According to Table 3, there is a statistically significant mean difference between pre-test and post- 
test scores of experimental group students with Scratch program (t29=-3,848; p<0,05). Post-test mean 
scores of experimental groups’ students (6,63)higher than their pre-test mean scores(4,56). This 
finding indicates that in experimental group with regular instruction there is a positive change on 
students’ leanings. 


In Table 4, post-test mean scores and standard deviations of students in control and experimental 
groups were given. 
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Table 4. Post-test Mean Scores and Standard Deviations of Students in Control and Experimental Groups 


Grups x S N 
Experimental Group 6,63 2,40 30 
Control Group 7,46 1,27 30 
Total 7,03 1,95 60 


According to Table 4, it can be seen that post-test mean scores (7,46) of students in control group 
are higher than post-test mean scores (6,63) of students in experimental group. 


After it was seen that there is a positive change in both groups’ learning, the effect of Scratch 
program on learning was examined. For this purpose pre-test scores were used as covariate, teaching 
method and gender were used as constant factors then two-way ANCOVA was conducted. This 
analysis was also used for examine whether there is a difference in achievements according to gender 
and group-gender interaction. Related findings were given in Table 5. 


Table 5. ANCOVA Results of Post-test Scores of Students in Control and Experimental Groups 


Source of Variance Sum of Squares sd Mean Square F p 
Corrected Model 12,179(a) 4 3,045 0,783 0,541 
Pre-test 0,379 1 0,379 0,098 0,756 
Group 10,323 1 10,323 2,656 0,109 
Gender 0,223 1 0,223 0,057 0,812 
Group*Gender 0,440 1 0,440 0,113 0,738 
Error 213,754 55 3,886 
Total 3194,000 60 
Corrected Total 225,933 59 


_According to Tahle 5, there is no statistically significant difference between post-test mean scores 
(* conte = TAG: * Experimental =0,63) of experimental group with Scratch program instruction and 
control group with traditional methods (F(.55)= 2,656; p>0,05). 


3.2. Student Achievement in terms of Gender 


To determine whether there is a difference between experimental group students’ and control 
group students’ post-test mean scores, pre-test scores were used as covariate, teaching method and 
gender were used as constant factors then two-way ANCOVA was conducted(Table 6). 


Table 6. Post-test Means, Standard Deviations and Sample Sizes of Groups in Terms of Gender 


Group Gender xe S N 
Girls 6,46 2,32 15 
Experimental Group Boys 6,73 2,54 15 
Total 6,60 2,40 30 
Girls 7,46 1,35 15 
Control Group Boys 7,46 1,24 15 
Total 7,46 1,27 30 
Girls 6,96 1,93 30 
Total Boys 7,10 2,00 30 
Total 7,03 1,95 60 
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In Table 6, post-test scores and standard deviations of students in control and experimental groups 
in terms of gender variable. Posttest mean scores of girl students in control group (7,46) are higher 
than post-test mean scores of girl students in experimental group(6,46). Similarly; posttest mean 
scores of boy students in control group (7,46) are higher than post-test mean scores of boy students 
in experimental group (6,73). In Table 5, the results that were obtained from covariance analysis 
indicated that there is no statistically significant difference between post-test mean scores in control 
and experimental groups in terms of gender(Fi1-ss)=0,812; p>0,05). This means students’ algorithms 
achievements in control and experimental groups do not differ in terms of gender. 


4. Discussion and Conclusion 


In this study, it was aimed to examine the impact of Scratch environment that was developed to 
provide an easy and funny way for learning computer programming by students, on student’s 
achievement in sixth grade ICT course algorithms subject. In the implementation process, it was 
observed that students were in positive attitudes towards Scratch and wanted to use such computer 
applications. According to results Scratch promotes students’ learning in sixth grade ICT course 
“algorithms” subject and it creates no significant difference on learning in contrast to traditional 
methods. This finding has similarity with some research results (e.g. Bayirtepe & TUziin, 2007; Sert, 
2009). In the literature, it was exposed by some researchers that there was an increase on student’s 
performance in the implementations of different methods for teaching programming and algorithms 
(Crescenzi et al., 2012; Futschek & Moschitz, 2010; Futschek & Moschitz, 2011; Gultekin, 2006; 
Monroy-Hernandez & Resnick, 2008; Peppler & Kafai, 2005, Resnick et al., 2009; Vobornik, 2011). 
Factors such as less implementation time period and students’ unfamiliarity with learning 
environment structure may be affective on these different results than literature. 


Another research result is that student’s achievement has no significant difference in terms of 
gender. This result has parallelism with Sert’ s (2009) research results. 


In this study, it was examined the impact of Scratch environment on student’s achievement in sixth 
grade ICT course algorithms subject. It may be useful to determine the impact of Scratch on learning 
with implementations of the learning environment in different grades in further research. 
Additionally, it may be conducted a qualitative research that has a long-term implementation process 
to determine impacts of the learning environment on learning. 
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